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(54) User communication and monitoring system for computer networks 



(57) The present invention relates to user commu- 
nication and monitoring system (UCMS) for computer 
networks, whore a user connects her client computer 
through networks to the host computer chosen by her 
and an information connectkxi is formed, which has fol- 
lowing features: 



Downloads 



the host computer has information as tiles and soft- 
ware for uploading a requested file to network , 
the client computer has software for requesting the 
file from the host computer and downloading and 
generating at least one screen or page for browsing 
from the downloaded file, 

client and host computers has support tor so called 
applet software, where a downloaded tile can em- 
bedded by an applet program, whfch is launched by 
certain user actions on the browser, especially ac- 
tions on the browsed page, and which applet pro- 
gram is able to communicate with the host computer 
and to send starting informatbn as well as periodic 
pulses so called heartbeats, and the host is adapted 
to record this information. 
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Figure 2. The client software model. 
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Description 

[0001 1 This invention relates to a user communication 
and monitoring system tor computer networks (UCMS) 
like the Internet. 

[0002] In a computerized information network like the 
Internet a user connects her client computer through 
networks to the host computer chosen by her and an 
information connection is formed, whch has following 
features: 

the host computer has information as files and soft- 
ware for uploading a requested file to the network, 
the client computer has software for requesting the 
file from the host computer and downtoading and 
generating at least one screen (or page) for brows- 
ing from the downksaded file, 
the client and host computers have support tor so 
called applet software (applet software is defined 
as a program that does not need a permanent stor- 
age medium like disk or tape, although it may be so 
stored), where a downtoaded file contains an em- 
bedded applet program, which is launched by cer- 
tain user actions on the client software, especially 
actkwis of downtoading or acttons on the downtoad- 
ed screen or page, and whk:h applet program is 
able to communcate with the host computer. 

[0003] In general, a page means a file, which has 
been downtoaded from the server. In this document, 
when the term page is used to mean a user tocation and/ 
or source for communication, it means any user tocation 
or set of tocatkxis. Even if not stated explicitly on each 
occasion, the term 'page* includes and/or Implies e.g. 
•a set of pages', 'a server' or 'servers'. 
[0004] Current World Wide Web (WWW) Technology 
is able to detect the arrival of visitors {'hits") on a WWW 
site or page. This information is often used on the page 
itself (e.g. 'Wetoome. You are visitor number 489.234 to 
this page'). It is also used as one measure of the 'suc- 
cess' of a page. 

[0005] Excluding the foltowtng WO-document there 
Is, at the time of writing, no way of directly and continu- 
ously monitoring the continuing presence of a visitor on 
a page, or when a visitor leaves a page voluntarily (e.g. 
by changing pages, leaving the program, or disconnect- 
ing from the network) or involuntarily (e.g. because of a 
machine or network crash). This information is needed 
to make real-time communication between users on the 
same page possible, and for subsequent measurement 
of visit durations. An indirectway of achieving this result 
(used to terminate the transmission of information to a 
visitor who has left) is by requiring visitors to install a 
'plug in' before they can access the page. Once the 
'plug-in' is installed on the client machine by the user, 
the "plug-in" provides 'leaving' information to the sen/er. 
There Is currently no direct way of achieving this result 
without actions to Install special software on the client 



machine by the user. 

[0006] PCT-publicalion WO 98/43380 introduces a di- 
rect method to measure veit duratton by applet calcula- 
tions on the client machine. This inventton does not sup- 

5 port ongoing information as to a user(s)' presence, does 
not support information on a user leaving involuntarily 
or by termtnatton of the connection, and does not sup- 
port or make possible any real-time communk::atkxi be- 
tween the users. 

TO [0007] The object of the inventton is to provide a user 
communication and monitoring system for Computer 
Networks (UCMS) and software that performs this func- 
tion. Another object of the inventkxi is to provide a sys- 
tem for generating ongoing real-time user tntormatton 

^5 (e.g. who is on the same page (including as already not- 
ed same set of pages or server(s)) at the same time) 
that is not vulnerable to interrupted communication {ma- 
chine crashes, network breakdowns, etc.). 
[0008] The UCMS introduces a direct method to 

20 measure visit duratton by applet (or similar) pulses 
{'heartbeats') on the client machine. The UCMS does 
support ongoing infornnatton as to a user(s)' presence, 
does support information on a user leaving involuntarily 
or by terminatton of the connectton, and does support 

2S and make possible various nrrodes of real-time commu- 
ntoation between users. As noted, these features are 
supported by a pulse, which Is herein called *a heart- 
beat'. This provides ongoing infornnatton on one or more 
users presence to the host, from which awareness of 

30 other users within the same page or same set of pages 
or server(s) can be generated, thus supporting the 
opening of communication in any medium between any 
users of whom the server (or linked server) is aware. 
[0009] The heartbeat information (and its cessatkan) 

3S received by the server can further be used to make an 
accurate calculation (external to and independent of the 
client) of the client leaving time and of visit duratton. In 
summary, Vne heartbeat provides informatton to the 
sen/er of visit duratton, of leaving time, of which users 

40 are really on-line, and this can support awareness by 
each user about which others are in the same 'place', 
and can hence support the opening of communication 
in any medium between these users. 
[0010] In the following, the invention is illustrated by 
4S reference to the accompanying figures, which show the 
UCMS mechanism. 

[0011] Figure 1 shows an UCMS operative model. 
[0012] Figure 2 shows a model of an UCMS client 
software e.g. applet. 
so [001 3] Figure 3 shows a model of an UCMS server. 
[0014] Figure 4 shows the procedure of establishing 
connecttons between clients. 

[0015] Figure 5 shows the case where the communi- 
cation occurs through the server. 
S5 [0016] Figure 6 shows the case where clients com- 
municate without passing messages through the server. 
[0017] UCMS is generic software with multiple uses, 
some of which are indicated in this paragraph. Currently 



2 



3 



EP 0 939 516 A2 



4 



there is no way to detect whether there are other users 
in the same page or in the same set ot pages. Many IRC 
(Internet Relay Chat) programs provide a place for chat- 
ting in WWW by importing IRC-programs from the Inter- 
net. However, those systems provide infomriation about 
other users in the same communication specific loca- 
tion, but do not provide any information from other users 
if they are not in a communication specific location, or 
in the same server, so it ts impossible to establish any 
communication channel generally with or between us- 
ers in the same or linked pages or set of pages or server 
(s). 

[0018] In addition, current WWW monitoring software 
only supports knowledge of "hits'. It does not support 
knowledge of how kxig any visitors stay on a page. It 
does not support cateulation by the host of aggregate 
statistk:al information or profiles on page usage such as 
mean or median length of stay, standard deviatkxi of 
length of stay, shape of length of stay curve, etc. It does 
not support passing information to other users or man- 
agers about who is 'on" a page at any given time. UCMS 
generates information and enables knowledge on arriv- 
al and departure time of visitors, and thus of duration of 
visit. This can be used by the host to generate: log files 
of arrival & departure times, and of length of stay for 
each visitor; aggregate statistical profiles of visit dura- 
tions; and information on who is 'on' a WWW page at 
any given time that can in turn have many further uses. 
Individual and aggregate visit duration information is po- 
tentially more valuable and accurate in monitoring the 
'success' of WWW sites, and in redesigning layout and 
marketing strategy. Informatkwi on who (e.g. whKh cli- 
ent) is "on* a given page at a given time can be used to: 
provide managers with information about who is current- 
ly on a page, and hence the ability to open communca- 
tion with users if desired; provide users vflth infornnation 
on who else is on the same page, and hence the ability 
to open commun cation with them rf desired. The former 
use (supporting vertical communicatbn) is an obvious 
commercial applicatkxi of UCMS. 
[001 9] It is anticipated that UCMS, when released, will 
be widely adopted, as there is currently no lightweight 
software available that supports mutual awareness by 
users, altows real-time communkatkin between the us- 
ers and/or generates WWW (or other Internet informa- 
tion base) duration <M visit information, and that does not 
require installation on the client machine (e.g. plug-ins). 
[0020] The basic mechanism of the UCMS is illustrat- 
ed in Figure 1, and a more precise description folk}ws 
Figure 2. When a user arrives on a web page, the down- 
load process is launched. Together with the page, she 
receives a small Java applet which is able to communi- 
cate with the server side UCMS program. The messag- 
es the client sends are the starting and closing times of 
the applet, and regular pulse messages (heartbeat) to 
indicate that the user is on-line and able to communicate 
(from technical point of view) with other users if neces- 
sary. Whenever the server receives a starting or ck>sing 



message, or fails to receive a heartbeat, it updates a 
log-file. 

[0021] Heartbeat rate is kept in the server's memory 
for faster reaction to any demand for communicatkxi. 

5 The log-file consists minimally of informatkxi about the 
togin and logout times of any web page (with klentifier 
and page-indicator) to which the applet has been added. 
This file can be used for nnany different purposes, e.g. 
real time monitoring of users or collecting tong-term sta- 

10 tistcs or for security reasons. 

[0022] Figure 2 illustrates the sequence of c^erations 
when the UCMS applet is started. At first ('Downkjad'- 
stage) the user types an URL-address and starts to 
download the page inlornrration to her own client com- 
puter With the HTML (Hyper-Text Modeling Language) 
code, she receives a client software (called an applet, 
which is e.g. programmed in Java) which is able to com- 
municate with the server side program. Orkce the down- 
toad is completed, the applet starts ('Client software 

20 starts'-stage) and informs the sender of its existence. 
With this information, the UCMS server is able to vwlte 
the LOGlN-time and any other available information 
from the client machine to the log-file. Minimally, with 
the time information, the sen/er saves some kind of kJen- 

25 tifier and page-indicator. 

[0023] After the page is completely downloaded and 
the applet is running, there will be a perkxj (kxig or short) 
of user actions ('User actions'-stage). She can read, 
view, or do whatsoever she is able and willing to do with 

30 the information on the page. In parallel to this, the applet 
regularly sends pulse message to the server ('Heart- 
beaf-stage). In the case of user disconnection, of net- 
work crashes, or other problems, this could cause the 
cessation of heartt>eat signals to the server side. The 

3S server reacts to cessation of heartbeat pulses by as- 
suming that the client is not on-line anymore, so it up- 
dates the log-file and refuses all connectkxi attempts to 
that client. In the case that the user changes the page 
or shuts down the applet (i.e. the stop or destroy meth- 

40 ods of the applet are called) ('Client softvrare shut- 
down'-stage), LOGOUT infornrratton is send to the serv- 
er. This process is similar to the process of 'Applet 
start'-slage, i.e. the applet transmits a notification mes- 
sage of shutdown to the UCMS-server, which then up- 

45 dates the tog-file and writes the logout time with similar 
information on kJentifier and page-indicator. 
[0024] Before the new web page is downloaded 
('Download of the new page'-stage), the applet is de- 
leted from the client. It is unnecessary for user to delete 
so any files or applications from her computer. If the new 
page that the user enters also includes the applet, it is 
downloaded and played in the same way as descrtoed 
above. In general, the applet is installed and operates 
(i.e. sends inlormatton to UCMS) automatically, but it is 
ss activated and terminated entirely by the user actions. 
[0025] The operational model of the UCMS server is 
very similar to the UCMS client software model. Figure 
3 illustrates the principles of such a model. At first 
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('Download request'-stage) the download request is re- 
ceived fronn the client. The server starts the page inlor- 
mation transmission ("page and applet transmission'- 
stage). Together with the page (HTML-information), the 
applet is transmitted. When the download request has 
been received, the WWW-server software updates an 
ordinary log-file (this log-file update is a standard pro- 
cedure, so it is not explained). However, this original log- 
file can now be used as a conrtparison file to calcutate 
the real number of visitors, (since all browsers do not 
currently support Java, such visitors will be missed by 
the UCMS mechanism). 

[0026] To return to the main flow, when the page in- 
lorrriation and applet have been transmitted, the sen/er 
shifts to the port listening stage ('listen to a port'-stage) 
with a previously set port. Once a start-up message from 
the client Is received, the server updates both the log- 
file by writing the LOGIN-time to the file and its* own 
merrwxy for possible demarwis for real-time communi- 
cation. Then the server keeps listening the port (actually 
the server listen s to port all the time, all other procedures 
are being completed by the WWW-server itself). In par- 
allel to listening to the port, the server checks that it re- 
ceives the heartbeat message regularly from the client. 
After a while, when the user changes the page she is 
viewing and sends a bgout message, or if the heartbeat 
pulse from the client is absent lor a few cycles in a row, 
the server shifts to the 'Client software acknowledge- 
ment-stage. In this stage, the sender writes LOGOUT- 
time to the log-file and removes the user from its' data- 
base, so no attempts to communicate are accepted. 
Then the server continues monitoring other visitors (or 
the original visitor on a new page). 
[0027] Figure 4 Illustrates the possibilities tor human 
communication. Several clients are connected to the 
server (the clients could be either in the same page or 
in different pages or on different servers). If communi- 
cation through the server is wanted (from the manage- 
ment point of view, or to keep the client software sim- 
pler), a client sends a message to the sen/er ('f^^essage 
received from a client' -stage, see also figure 5). The 
message indicating required message type (e.g. text- 
message, audio or video stream etc.) includes an ad- 
dress-tag, so the server simply passes it to the appro- 
priate client. On the other hand, if a client wants to com- 
municate directty without using the server as a gateway, 
the client requests an address of the recipient from the 
server ('Address request'-stage, see also figure 6), 
which then replies and sends the address. Therefore the 
client can establish a communication channel directly to 
the appropriate client. The latter approach can be used 
when two'clients want to communicate, while the former 
one is more appropriate for multiparty communication. 
[0O28] To take into account cases when the client 
computer or network crashes, or the user terminates the 
connection, and for other reasons, the applet in the cli- 
ent updates its existence at intervals e.g. of 1 second 
(generally in the range 0,001 - 5 min). The lower part of 



the range will be proper in the future e.g. in the asyn- 
chronous transfer nrxxJe (ATM). The interval must be rel- 
atively short in order to provide accurate information on 
which to base communicatkn with or between users. 

s For example, in a direct vkieo or audio communicatkxi 
the interval range is preferably 0,001 - 1 sec, while tn a 
indirect communication it is preferably 1 sec - S min. 
[0029] The data directly from the applet, or indirectly 
from the bg-file can be used for many different purposes 

10 as noted earlier. By comparing the UCMS k>g-file to the 
type of k>g-file currently generated by web browser, it Is 
possttite to cabulate the number of users incapable of 
running applets (i.e. those on whom UCMS has no in- 
formation). By the use of this comparison, it is possible 

15 to calibrate the statistical information from UCMS more 
precisely. With time, the proportksn of clients that cannot 
receive applets (or be simitarty enabled) can be expect- 
ed to decrease greatly. 

[0030] Especially, when Java is used, the file, which 
20 presents a downloadable page, includes one or more 
text variables for the applet on the page for use in sys- 
tem administraton e.g. by a web master. There are the 
following useful variables: 

25 - heartbeat intervals for real-time connmunication and 
robustness of sen/er side informatkyi, 
page identification for starting and cbsing informa- 
tion, 

port number for communkzatkxi between the applet 
30 In the client and the host program, 

image fil e for displaying on th e page with the applet 
- the applet provkier's URL i.e. the address of the UC- 
MS-server 

35 [0031] Because the Java binary code is universal, all 
client and server dependent variables such as heartbeat 
rate, page identifier and pon number should be included 
on a www-page, not in the binary distributkxi. There- 
fore the same Java applet can be used with all pages 

40 each page containing unique identrfication variables. 
[0032] An image file and URL above are optkyial. 
[0033] A Java applet according the Inventwn contains 
at least initialization, starting, heartbeat, stopping and 
destroying routines. The login code locates in the start- 

45 ing section and the logout code in the stepping section, 
respectively. The original Java software may be re- 
placed by Microsoft Java or other Java versbn, or even 
by some other software written for simitar kind of pur- 
poses as original Java developed by Sun Microsystems. 

so [0034] One of the uses of UCMS is as a communfca- 
tion channel. For example, in electronic commerce (EC) 
applicatkins, a on-line customer could ask questions in 
real-time of the vendor or producer while she is shop- 
ping in an electronc market place; or vice versa, the 

55 vendor may offer online help for the customer. Currently 
there are no such possibilities in EC applications. The 
communication possibility can also be used in many oth- 
er situatbns and applications in whbh human-human 
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interaction is needed. 

[0035] One ot the uses ot the log-file is as a real time 
user monitor, i.e. to find out who is looking at a particular 
page at the given moment. UCMS is designed to gen- 
erate real time information on a web page H necessary. 
Inlonmation display formats for UCMS real time user in- 
formation (w^o is on the same page at the same time) 
are being developed in both 2D and 3D. The display for- 
mats take into account the need for scalability, since the 
number of users on some commercial pages may be 
very high. 

[0036] For example, in the case of 3D presentation. 
UCMS is able to read the tog-file and send the informa- 
tion to a client VRML browser, which changes the ap- 
pearance of the work! using the instructions it receives 
from the server. There shouW be an automatic genera- 
tor, which creates the VRML file from the files located 
on a web server. The generator goes through the direc- 
tories the administrator has specified, and reads the UC- 
MS applet definitions from those pages. From this data, 
the generator is able to generate a 3D projection of web 
information. The Java code, which is later needed lor 
the communication with the UCMS server, is added from 
another file. This process is completed each time when 
a new page with the UCMS applet is installed to provide 
accurate information atx>ut the server. The appearance 
of the world is a 3D model of a set ot web pages or server 
(s) in which the online users (as detected by the UCMS) 
are represented indrviduaify or in aggregate as appro- 
priate. 

[0037] Log-files can also be used tor monitoring users 
real-time in some 'groupware' software applications. E. 
g. with the BSCW system from GMD (Gerrr^n Natior^al 
Research Center for Informatkxi Technology) the users, 
who share a workspace, are known directly because of 
user identificatton and password protection. It is possi- 
ble to combine UCMS and GMD-BSCW to create a new 
identificatbn file. On addition to ordinary UCMS tog-file, 
this new file includes real user identification, i.e. login 
and -out times and IP number as usual, and, in addition, 
real name user id. Supporting such combined informa- 
tion is which requires merging or linking these two ap- 
plications, i.e. some modification either to the applica- 
tion itself or to the UCMS viewing program is needed. 
This topic is an applicatton, not related to this specifica- 
tion. 

[0038] Communtcatton channels tor audio, video, text 
messages, and document transfer for users on the 
same page can be created from the UCMS files in sim- 
ilar ways to those discussed above for VRML and GMD- 
BSCW. 

[0039] Since the log-file, which is created by the UC- 
MS server, is formatted differently to the history record 
output, conversion is needed before output. The original 
log-file consists only of data on login and logout times. 
The time for which the user actually viewed the page (or 
the time the applet was running) can be calculated from 
those numbers. This information can be easily shown 



on a 2D interface and/or used to create 3D workJs for 
the users and/or used as a basis for audto, video, text 
messaging, or document transfer (see above). The orig- 
inal log-file should remain unchanged by any statistics 
5 that are cakiulated, since It may be needed in the future. 

Generality 

[0040] In the atKive text, the specific programming 
10 language Java, and the specific networking mechanism 
of the World Wide Web, including 'appler, have been 
used to exemplify and instantiate the UCMS server and 
client programs and operations. The UCMS client-serv- 
er mechanisms are intended to be entirely general, and 
IS to operate in any networking/program environment that 
is similar in the relevant respects. 
[0041] The Java programming language is disclosed 
in numerous books, e.g. Ken Arnold, James Gosling: 
The Java Programming Language; Add is ion- Wesley, 
20 1996. 



Claims 

2S 1. User communicatton and rrranitoring system (UC- 
MS) for computer networks, where a user connects 
her client computer through networks to the host 
computer chosen by her and an informatton con- 
nection is fomned, which has following features: 

30 

the host computer has information as files and 
software for uploading a requested file Mo 
network , 

the client computer has software for requesting 
35 the file from the host computer and download- 

ing and generating at least one screen or page 
for browsing from the downloaded file, 
client and host computers has support for so 
called applet software, wherea downk>aded file 
40 can embedded by an applet program, whtoh is 

launched by certain user actions on the brows- 
er, especially actions on the browsed page, and 
whtoh applet program is able to communicate 
with the host computer and to send starting in- 
4S formation representing the starting time of the 

browsing of the page, and the host is adapted 
to record this informatton. 

characterized in that the applet software is adapted 
so also to send pertodic information (so called heart- 
beats) to the host computer, which is adapted to 
keep record of these heartbeats representing the 
user being active in the page. 

55 2. User communication and rnonitoring system ac- 
cording to claim 1, characterized in that the host 
computer creates a separate file from the recorded 
information presenting a real-time view of the users 
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3. User communication and monitoring system ac- 
cording to ctaim 1 or 2, where the applet software 
uses virtual ports for communication, characterized s 
in that in each time that the page information and 
the applet have been transmitted to the client, the 
host shifts to the port listening stage with a previ- 
ously set port and starts to chectt heartsbeats from 
the client in a predetermined rate. io 



4. User communication and monitoring system ac- 
cording to one of clainrts 1 • 3, 
characterized in that the host computer counts the 
browsing time erf the page according to the heart- 
beats received from the client. 



5. User communication and monitoring system ac- 
cording to one of claims 1-4, 

characterized in that the applet software is adapted 20 
also to send closing infornnation to the host compu- 
ter representing the finishing time of the browsing 
of the page. 



6. User communication and rTxanitoring system ac- 2S 
cording to one of claims 1 - 4. 

characterized in that the network is Internet and the 
UCMS code, the applet and/or server side pro- 
grams, are programmed in Java. 

30 

7. User communication and monitoring system ac- 
cording to claim 4 or 5, 

characterized in that the file presenting a download- 
able page contains one or more variables for the 
applet in the same file, which variables belong to 3S 
the following group: 

page identification for starting and closing infor- 
mation, 

port number for communication between the 40 
applet in the client and the host program, 
heartbeat rate, 

image for displaying on the page with the ap- 
plet, 

url i.e. the address of the UCMS-server. ^ 



8. User communication and monitoring system ac- 
cording to one of claims 1 - 7, 

characterized in that the applet in the client updates 
its existence at intervals in the range 0,001 - 5 min. 50 

9. User communication and monitoring system ac- 
cording toclaim 6 for video or audiocommunication, 
characterized in that the updating interval is in the 
range 0,001 - 1 second. ^ 
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Figure 1. UCMS operative model 
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Figure 2. The client software model. 
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Figure 4. The multiparty communication. 
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Figure 5. Communication through the server. 
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Figure 6. Communication without the server. 
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